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Abstract. We consider the convex optimization problem min x {/(x) : gj(x) < 

0, j = 1, ,m} where / is convex, the feasible set K is convex and Slater's 

condition holds, but the functions gj's are not necessarily convex. We show 
that for any representation of K that satisfies a mild nondegeneracy assump- 
tion, every minimizer is a Karush-Kuhn- Tucker (KKT) point and conversely 
every KKT point is a minimizer. That is, the KKT optimality conditions are 
necessary and sufficient as in convex programming where one assumes that the 
(jij's are convex. So in convex optimization, and as far as one is concerned with 
KKT points, what really matters is the geometry of K and not so much its 
representation. 



1. Introduction 

Given diffcrcntiable functions /, Qj : M™ — ► R, j = 1, . . . , m, consider the follow- 
ing convex optimization problem: 

(1.1) /* := inf {/(x) : xeK} 

X 

where / is convex and the feasible set K C M. n is convex and represented in the 
form: 

(1.2) K = {xeM" : ffj (x) < 0, j = l,...,m}. 

Convex optimization usually refers to minimizing a convex function over a convex 
set without precising its representation (see e.g. Ben-Tal and Nemirovsky [TJ Defi- 
nition 5.1.1] or Bertsekas et al. [3l Chapter 2]), and it is well-known that convexity 
of the function / and of the set K imply that every local minimum is a global min- 
imum. An elementary proof only uses the geometry of K, not its representation by 
the defining functions g^\ see e.g. Bertsekas et al. [H Prop. 2.1.2]. 

The convex set K may be represented by different choices of the (not necessarily 
convex) defining functions Qj, j = 1, . . . , m. For instance, the set 

K := {x e M 2 : 1 - Xl x 2 < 0; x > 0} 

is convex but the function x i— > 1 — £1X2 is not convex on Rq_. Of course, depending 
on the choice of the defining functions (<?j), several properties may or may not hold. 
In particular, the celebrated Karush-Kuhn- Tucker (KKT) optimality conditions 
depend on the representation of K. Recall that x G K is a KKT point if 

m 

(1.3) V/(x)+5^A i V 5i (x)=0 and Xj g 3 (x) = 0, j = 1, . . . , m, 

for some nonnegative vector A S R m . (More precisely (x, A) is a KKT point.) 
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Convex programming refers to the situation where / is convex and the defining 
functions gj of K are also convex. See for instance Ben-Tal and Nemirovsky [TJ p. 
335], Berkovitz [|2, p. 179], Boyd and Vandenberghe [Hp. 7], Bertsekas et al. [3J 
§3.5.5], Nesterov and Nemirovskii 6, p. 217-218], and Hiriart-Urruty [5]. 

A crucial feature of convex programming is that when Slater's condition holdsQ, 
the KKT optimality conditions (jl.3p are necessary and sufficient, which shows that 
a representation of the convex set K with convex functions (gj) has some very 
attractive features. 

The purpose of this note is to show that in fact, when K is convex and as far as 
one is concerned with KKT points, what really matters is the geometry of K and 
not so much its representation. Indeed, we show that if K is convex and Slater's 
condition holds then the KKT optimality conditions (jl.3|) are also necessary and 
sufficient for all representations of K that satisfy a mild nondegeneracy condition, 
no matter if the g^s are convex. So this attractive feature is not specific to repre- 
sentations of K with convex functions. 

That a KKT point is a local (hence global) minimizer follows easily from the 
convexity of K. More delicate is the fact that any local (hence global) minimizer 
is a KKT point. Various constraint qualifications are usually required to hold at a 
minimizer, and when the g^s are convex the simple Slater's condition is enough. 
Here we show that Slater's condition is also sufficient for all representations of K 
that satisfy a mild additional nondegeneracy assumption on the boundary of K. 
Moreover under Slater's condition this mild nondegeneracy assumption is automat- 
ically satisfied if the g^s are convex. 

2. Main result 

Let K C M™ be as in (|1.2|) . We first start with the following non degeneracy 
assumption: 

Assumption 2.1 (nondegeneracy). For every j = 1, . . . ,m, 

(2.1) V(?j(x) ^ 0, whenever x € K and <7j(x) = 0. 

Observe that under Slater's condition, ()2.1j) is automatically satisfied if gj is 
convex. Indeed if (^(x) = and V<?j(x) = then by convexity is the global 
minimum of gj on W 1 . Hence there is no xq £ K with £fj(xo) < 0. We next state 
the following characterization of convexity. 

Lemma 2.2. With K C M™ as in U.ty) , let Assumvtion \2.1\ and Slater's condition 
both hold for K. Then K is convex if and only if for every j — 1, . . . , m: 



Proof. Only i/part. Assume that K is convex and (V<?j(x),y — x) > for some 
j € {1, . . . , to} and some x, y 6 K with gj(x) = 0. Then ^(x + t(y — x)) > for 
all sufficiently small t, in contradiction with x + t(y — x) 6 K for all < t < 1 (by 
convexity of K). 

//part. By (|2.2p . at every point x on the boundary of K, there exists a supporting 
hyperplane for K. As K is closed with nonempty interior, by 8 [Th. 1.3.3] the set 



(2.2) 



(V 5i (x),y-x) < 0, VxjeK with 9j(x) = 0. 




□ 



Slater's condition holds for K if for some xo £ K, gj(xo) < for every j = 1, ... , m. 
'The author wishes to thank Prof. L. Tuncel for providing him with the reference [8]. 
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Theorem 2.3. Consider the nonlinear programming problem 11. 1]) and let As- 
sumption \2.1\ and Slater's condition both hold. If f is convex then every minimizer 
is a KKT point and conversely, every KKT point is a minimizer. 

Proof. Let x* e K be a minimizer (hence a global minimizer) with /* = /(x*). 
We first prove that x* is a KKT point. The Fritz- John optimality conditions state 
that 

m 

A V/(x*) + x j Vft(x*) = 0; A jffj (x*) = 0, j = 1, . . . ,m, 

3 = 1 

for some non trivial nonnegative vector ^ A 6 R m+1 . See e.g. Hiriart-Urruty [5J 
Th. page 77] or Polyak [3 Theor. 1, p. 271]. We next prove that A ^ 0. Suppose 
that Ao = and let J :— {j G {1, . . . , to} : Xj > 0}. As A ^ and Ao = 0, the set J 
is nonempty. Next, as 5j(xo) < for every j = 1, . . . , to, there is some p > such 
that B(x ,p) := {z 6 R n : j|z - x || < p} C K and gj(z) < for all z S B(x ,p) 
and all j € J. Therefore we obtain 

(V.9,(x*),z-x*> =0 VzeB(x ,p), 

which, by Lemma 12.21 implies that (V(?j(x*),z — x*) = for every j € J and 
every z 6 £>(xo,/o). But this clearly implies that Vgj(x*) = for every j € J, in 
contradiction with Assumption 12. 11 Hence Ao > and we may and will set Ao = 1, 
so that the KKT conditions hold at x*. 

Conversely, let x e K be an arbitrary KKT point, i.e., x 6 K satisfies 

m 

V/(x) + £ A, V gj (x) = 0; \ 3 g 3 (x) = 0, j = 1, . . . , to, 
i=i 

for some nonnegative vector A G K m . Suppose that there exists y e K with 
/(y) < /( x )- Then we obtain the contradiction: 

> /(y)-/(x) 

> (V/(x), y - x> [by convexity of /] 

m 

= -E A ^ v -^( x )-y- x ) ^° 

i=i 

where the last inequality follows from A > and Lemma [2.2l Hence x is a minimizer. 

□ 

Hence if K is convex and both Assumption 12 . 1 1 and Slater's condition hold, there 
is a one-to-one correspondence between KKT points and minimizers. That is, the 
KKT optimality conditions are necessary and sufficient for all representations of K 
that satisfy Slater's condition and Assumption 12.11 

However there is an important additional property when all the defining functions 
<7j are convex. Dual methods of the type 

!m 
inf /(x) + V Xjgj{x) 

are well defined because x t— > /(x) + 2j=i ^jffj( x ) ^ s a convex function. In par- 
ticular, the Lagrangian x i— > £/(x) := /(x) — /* + Y^j=i ^iffi( x ); defined from an 
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arbitrary KKT point (x*, A) E K x R™, is convex and nonnegative on R™, with x* 
being a global minimizer. If the gfs are not convex this is not true in general. 

Example 1. Let n = 2 and consider the problem 

P : /* = min { /(x) : a - x x x 2 < 0; Ax < b; x > }, 

where a > 0, A G R mx ™, b £ R m , and / is convex and differentiable. The set 

K := {x e R 2 : a - x x x% < 0; Ax < b; x > } 

is convex and it is straightforward to check that Assumption 12.11 holds . Therefore, 
by Theorem l2.3[ if Slater's condition holds, every KKT point is a global minimizer. 
However, the Lagrangian 

x i * /(x) - /* + ip(a - xix 2 ) + (A, Ax - b) - (^,x), 

with nonnegative (ip, A, fi) € R x R m x R™, may not be convex whenever tp ^ (for 
instance if / is linear). On the other hand, notice that K has the equivalent convex 
representation 



K 



jx S R 2 : 


xi yja 




\fa x 2 



y 0; Ax < b 



where for a real symmetric matrix B, the notation B y stands for B is positive 
semidcfinite. 

A topic of further investigation is concerned with computational efficiency. Can 
efficient algorithms be devised for some class of convex problems (ll.ip where the 
defining functions gj of K are not necessarily convex? 
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